Conversation
|
Make changes: Tab 1: Direct Table Path Tab 2: Managed Table (Catalog) |
Results look correct: 51,793 rows — matches TPC-H lineitem SF0.01 with the l_extendedprice < 10000 rows deleted (per the README, full SF0.01 has ~60K rows) 16 columns — standard TPC-H lineitem schema (l_orderkey, l_partkey, ... l_comment) Types are reasonable — INTEGER, DECIMAL(15,2), VARCHAR, DATE Both models (with and without secrets) return the same 51,793 count
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
web-common/src/features/templates/ConnectionTypeSelector.svelte
Outdated
Show resolved
Hide resolved
web-common/src/features/templates/ConnectionTypeSelector.svelte
Outdated
Show resolved
Hide resolved
Resolve conflicts in JSONSchemaFormRenderer and GroupedFieldsRenderer. Update ConnectionTypeSelector to use v2 runtime client API. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
| - # Example: Iceberg model reading from GCS | ||
| type: model | ||
| connector: duckdb | ||
| create_secrets_from_connectors: gcs |
There was a problem hiding this comment.
rill support google json credendtial but duckdb only support hmac so I think iceberg_scan only support hmac too. May be better to mention here.
runtime/drivers/duckdb/duckdb.go
Outdated
| fmt.Sprintf("SET secret_directory=%s", safeSQLString(secretDir)), | ||
| ) | ||
| } | ||
|
|
There was a problem hiding this comment.
is there any change in this?
There was a problem hiding this comment.
ah there was an issue when using iceberg but since its auto installed, reverted!
| {}, | ||
| { query: { enabled: hasRequiredDrivers } }, | ||
| ); | ||
| $: disabledOptions = (() => { |
There was a problem hiding this comment.
nit: when data directly depends on a query response we use selector functions.
Something like,
function getDisabledOptions(client, requiredDrivers) {
const hasRequiredDrivers = Object.keys(requiredDrivers).length > 0;
return createRuntimeServiceAnalyzeConnectors(
client,
{},
{
query: {
select: (data) => {
const existingDrivers = data.connectors.map...
const disabled: Record<string, string> = {};
...
return disabled;
},
enabled: hasRequiredDrivers,
},
},
);
}
Adds Apache Iceberg as a new connector, leveraging DuckDB's native Iceberg support. Tested with local filesystem and GCS catalogs.
Backend:
Frontend:
Documentation:
Integration tests:
Checklist: